Neural heuristics for scaling constructional language processing
نویسندگان
چکیده
Constructionist approaches to language make use of form-meaning pairings, called constructions, capture all linguistic knowledge that is necessary for comprehending and producing natural expressions. Language processing consists then in combining the constructions a grammar such way they solve given comprehension or production problem. Finding an adequate sequence constitutes search problem combinatorial nature becomes intractable as grammars increase size. In this paper, we introduce neural methodology learning heuristics substantially optimise processes involved constructional processing. We validate case study CLEVR benchmark dataset. show our novel outperforms state-of-the-art techniques terms size space time computation, most markedly direction. The results reported on paper have potential overcome major efficiency obstacle hinders current efforts large-scale construction grammars, thereby contributing development scalable systems.
منابع مشابه
Neural Network Methods for Natural Language Processing
Imagine that you get such certain awesome experience and knowledge by only reading a book. How can? It seems to be greater when a book can be the best thing to discover. Books now will appear in printed and soft file collection. One of them is this book neural network methods for natural language processing. It is so usual with the printed books. However, many people sometimes have no space to ...
متن کاملScaling conditional random fields for natural language processing
This thesis deals with the use of Conditional Random Fields (CRFs; Lafferty et al. (2001)) for Natural Language Processing (NLP). CRFs are probabilistic models for sequence labelling which are particularly well suited to NLP. They have many compelling advantages over other popular models such as HiddenMarkovModels andMaximum Entropy Markov Models (Rabiner, 1990; McCallum et al., 2001), and have...
متن کاملHeuristics-based entity-relationship modelling through natural language processing
Here we propose new heuristics that assist the semi-automated generation of Entity-Relationship (ER) diagrams for database modelling from a natural language description and describe the implementation of such a system called ER-Converter. Though this is a semi-automatic transformation process, ER-Converter aims to require minimal human intervention during the process. ER-Converter has been eval...
متن کاملPrecision Scaling of Neural Networks for Efficient Audio Processing
While deep neural networks have shown powerful performance in many audio applications, their large computation and memory demand has been a challenge for real-time processing. In this paper, we study the impact of scaling the precision of neural networks on the performance of two common audio processing tasks, namely, voice-activity detection and single-channel speech enhancement. We determine ...
متن کاملTowards Bidirectional Processing Models of Sign Language: A Constructional Approach in Fluid Construction Grammar
Sign languages (SL) require a fundamental rethinking of many basic assumptions about human language processing because instead of using linear speech, sign languages coarticulate facial expressions, shoulder and hand movements, eye gaze and usage of a three-dimensional space. SL researchers have therefore advocated SL-specific approaches that do not start from the biases of models that were ori...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Language Modelling
سال: 2022
ISSN: ['2299-8470', '2299-856X']
DOI: https://doi.org/10.15398/jlm.v10i2.318